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(g) Data compre ss lon/decomprB ss km and storage of compressed and uncompressed data on a single 



) A data fie havDig a phjraiiy of data blocks Is 
divided into one or more transfer unds of data 
bkxdcs. Before data st o r a g e , each transfer unft 
of data blodcs is subjected to as am data 
c om p res sw n cyde to create a group of oonv 
pressed data blocks. The size of the data trans- 
fer urat in bytBs» is selected to be fade for 
a ddres si ng and retrieving individual recorded 
groins of compressed data bkxfcs whie provkt- 
ing good channel utfization and oompression 
^fidenqf. Also the data4ransler uni size is 
selected in part based upon data storage eifh 
dency. Lei the stor age of tlis compressed data 
should fB as marijf addressable data storage 
areas as p o ss lb te. Upon reoonfihg each group 
of compressed data bytes^ an entry is made into 
a fie directory fbr enabGng addressing ttie re- 
corded compressed data blocks^ 
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FIELD OF THE MVEMOON 

Tfe invention retales to data storage systems that are capa We of storing both compressed and unconv 
pressed daia on ofte dafca storage vcrfume and to data processing systems utS^ 
5 This invention atsoreCates to data stora^systerns that minimize wasted data storage space on a data storage 
vohjme whte storing compressed daft& 

BACKGROUND OF IHE INVENTK)N 

10 Mwiy data storage mecfia, such as data storage optical disks* have a so-caDed fixed biock architecture 
(FBA) fbrmat Sudi format is Gtiaracterized In an optical d^ 

track into a plural^ of sectors^ Everyone of the sectors have identkal data storage capacfty, Le. 512 l>ytes» 
1Q24 lyytes, 4096 l^ftes, et& Because of the FBA disks and the variat^ii^ 

with respect to the some unoompressad data, in-line data compresston has not been empkiyed wfth FBA for- 
ts malteddisks.ltisdesiredtoeffkaenftystDreandenablesiniiplerandoma^^ 
of compressed data resulting Ihjm cornpressmg data whch has been fb^ 

compressed data cffli then be recontedonaFBA formatted disk, tfthesectordata does not compress to fewer 
bytes, then the data are stored wfthout dato compresston on the data storage disk. 
ItisalsodesiredwhenapiuaiilyofaddressabtodatoUodcsisseginentBdin^ 

20 data blocks, to maintain host processor addressabi^ of the compressed data Uocks within each compressed 
group of dato bkxiQw R isalso desired when cornpres^ng data for storage on a FBAstorage rnediu^ 
a maxintal adcfress^^aty of aD unused data storing sectore even though the number of 
the compressed data btocks is unknown. A further desire is to provkte for random addressmg of the com- 
pressed data bloGks recorded in an FBA formatted storage medium. 

2S The data pattern landornness of most input data strearns and the variabaityki the result^ 

compressed data output after the appKcatkm of the vanous o om pressfon algorithms^ does not allow for the 
predictton of the amount of stora^ space required to contain the compressed data. This situatton requires a 
link behNmn the transnttsskm of the d^ stream to be compressed and reconied and the resul 
presskMiprocesstoassistthe host processor in its storage management process. 

30 The fuiictfon of updating a data fie In tins erivironment can not use any usual d^ 

update, wrtB back) because the data pattern as a result of the update may not compress to the same degree 
as the or(£^ dala btock and therefore updated oornpressed dato most probably 
age space required to store the ofigmai data. 

Inafbcedbtecfc a rdi itB CturB (FBA) envirorenent date are reoofdedona 

35 units <tf storage caDed sectors where each recording track on the ntedkim contains afoced number of such sec- 
tors. The addressing comrentfon for optkal disk devfees consists of a track addre^ 
number of the partxular track. On optkal media storage devK»s» each of tte 
parts;anl d ent r icatk)nfieid(ID)usedbytfaedevk»contrDUertolocateap 
andadatafieklfDrstoring data ITielnforrnatkimtf content of the ID'son hard sectorM 

40 reconted,asbyastarnpingArokling process,ontherned(umatthetirneof nranuf^^ 

formats also are usabto to practice the present inventton. such as the known count-key-dato (CKD) and ax- 
tended count-kay-data (|ECKD) forinats used on many magnetic disk nwdia. 

An FBA d6vk» attached to a host vn the known Small Computer Standard Interface (SCSI) must p 
the capabiity to resolve a LogkalBtock Address (LBA) used by SCSI architected directaccess date storey 

45 devk»stoaddressffxedsizedunit3of^oragetoaunk|uephy8kaladdress(trackandsec^ 

The SCSI attached FBA devk» provkies to the host a contiguous address space of N (N is a posft^ 
storage focations which can be access ed for reading or writing in any secpience. Each IBA directory structore 
(addresses ranging from 0 to N) is the addressing mechanism used to store and retrieve date blocks in the 
SCSI-FBA environment (some FBAdevkas also provkJe the capabiity to address the storage space using the 

so physical address). 

Ascan beseenfiromthe preceding paragraphs, the principal problem fadng a designer crfastorege system 
using date compressfon technk|ues to the SCSi-FBA environment is to provkle a mechanism by whfch f bced 
size units of data, herein termed date bkxdcs, in an Input date stream can tie recorded in a variable amount of 
storage medium space and sta maintain addressabBity to the unoccupied storage space and provkie for ad> 
55 dressabiity to the recorded <tete blocks. 

Since many ofrtkal disks today are of the removable type, it is further desired to enabte each removable 
date storage nnedkHn to be self^lescribing as to cornpressed and uncornpressed date held thereon. 
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DISCUSSKM OF THE PRIOR ART 

The Vbsacek US patent 4»499J539 shows fvst aftocadn^ 
orbufferfbrstonngamaK&mim 
storaga devte (DASD) oomieGtBd Id the cache or txif^^ 

protocol is to stage or transfer one track of DASD data to ttie cache or tMjffer in one bipuloutpiit opeialkm 

(one access to the DASD). Upon completion of ttie actual data transfer, the cache or t)uffer is examined. If 

less than an of the first alkxated segments contain data, then the em{^ allocated seg^^ 

Pointers are reoonJed in afirst one of the allocated segments fcMT potn^ 

store data from the same DASD tiaciL hi this manner the DASD track is em^^ 

IIS Patent No5097261 (appfkatkm hk> US^ 07/441,126) shows a data cornpactta 
tape peripheral data stor^ sy^em. Tapes do not have any addressable data storage areas. The entire tape 
is formatted each time t is recorded. This fbrrnatting feature in rna^ 
records as variablv sized bkxAs<rfdata. The storage of uncflmpra^ 

btocks of such data. The application does show imiuding a plurafity of reoords in one ttock of data recorded 
on the tape. Co-pencfing commorrfy-assigned US patent application USSN 07/372,744. fled 6/2a/8g,(/\ttomey 
docket TU989003)shoMi^ a magnetic tape data storage system that automatxsdiy ^ores a plural^ of small 
reoonis in each t)tock of reconied data. Each of the records reinain indi^ 
l)ining a pturaOy off raoinls bi one l)k)ck is t(> reduce the nurnber of intar4>^ 
capacity of the magnetic tape. 

Data compresskm and deooriyresskm aigorithrns ami systems are weS km 
an in line (real tirne) data cornpressM>n/decoinprBsskm sy^em for use in high spe^ 

uses an algorithm shown in the Langdon, Jr. et al US patent 4,467,31 7. Batch processed (software) data com- 
presskmanddecornpresskm isatoweU knowa PIOAfARE. incL, 7032 Ardar^ 

provklBS the software pro gr am s PKZIP for batch compressbn, PKUNZIP fior batch decompressbn among 
other oompres si on-deco m pressfonsoftwge. Another data compression-decomp r essfon al^vithm has been 
used for both batch (software processmg) and in-line (hardware-integrated semiconductor chips) processing. 
The known Laaip^ 2^1 data co mp resskm/decompression algorithm is used for bc^h in-line (real time) and 
batch drtacompresskm and deoornpre ss ton. ft Is preferred to use the latter al^ Shah and Johnson in 
the artnie DATA COMPRESSOR DECOMPRESSOR IC in tto "1990 IEEE IntematkHial Symposium on Cir- 
cuits and Systems, New Orleans LA (pp 41-43) on May 1-3, 1 990 describe an integrated circuit using t he 
known Lempel>Ziv algorithm mentnned above. In practicing the present inventkm, it is preferred that a conv 
presskm-deoompresson algorithm that feciitates both batch and in line operatkm be used. Of course^ only 
batch or only In line data co mp ressfon-decompresston may be used to suocessfUly practce the present irv 
vention. 

Images or "horvcoded" data have been compressed and decompressed for saving data storage space. 
Reilaina US patent 4»B22;585 shows one vkteo oompresston scheme. 

SUMMARY OF THE INVENTK»4 

The present inventfon provkies flexible data o ompre ss ion-decompressfon controls that enable randomly 
accessing compressed data through relatively simpte accessing mechanRsms. 

According to a first aspect, the present invention provkies apparatus for storing data In compressed form 
In a data storage devk» havnig a plurality of addressable fike-sized data storage areas, each to 
predetermined numl)erGf data t)yfies» tte data storage device t)eing connected to means for receiving data to 
be recorded, saki received data bemg arranged in a plurality of addressable data btocfc^ 
the apparatus comprises, in co mbi nation: setection means in the means for receiving data for selecting one 
or more data transfer units of data btocks to be recorded, each said transfer unit of data blocks having a given 
number of data tyytes and 'mducfing one or more of saki addressable data Nocks; compressfon means con- 
nected to the selection means for compressing said transfier unit of data blocks to be recorded as a group of 
compressed dEda bk>cks; data access means in the device connected to sahl com p res s ion means for recording 
saki group of cornpressed data bkMte ki saki addressable data storage areas as one continuum of corn^ 
data; and directory means indicating whk:h ones of said addressable data storage areas saki continuum of data 
is recorded n. aiKl imficating that sakt continuum of data contains sakI selected transfer unft of data btocks in 
a compressed form. 

In a second aspect of the present mvention there is provkJed a method of oompressing and recording onto 
a data storage medkim data of a file whtoh is arranged in a plurality of addressable data btocks, tte method 
oomprlsmg the steps of. setocting a phvality of saM data blocks of sakI fQe to be compressed and recorded; 
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se gm enting the seteciBd pluraBty of addfessab ie date bt^^ 
each of sakt one or more data tra'tsferunis and reoonibgt 
data blocfcs; and creating and mairriffinmg a fte di^^ 
corded gmups for enabing landom access tD recorded data 

Pr^Brabiy. Ihefie directory proyides information fw 
in a groupJt is firther preferred that the directory is maintai 
data storage medium conta in ing the group of compressed data Modes. 

In a pr^ierred ernt>odiment of the praserit invention, a data fie having a pluf^^ 
issegmentedintoapluraayofgroupsof su:h data blocks. Each grt>up of data b^ 

and decompressed as one unft of data. Each such group is separately transmuted between a host processor 

and a data storage iBnt com muni cat i ons link etc as one data transfer unit (DTU). The ^ of the DTU, in terms 

of the number of d^ btodcs to be included* is determmed emptricaily based upon the data storage capacity 

of (number of data tafias storabletn) sectors Into which a data storage vohjme Is dj^^ number of bytes 

in each of the data blocfcs of the data fie. and other system p arametera. The data storage of each group in 

compressed form in a data storage device is descra>ed by the data borage system to the 

ferably by a c omm an d fttod to the host processor aimmand effecting the data borage form. 

The host processor estabfi^ies a (firectory cfescrlfoing the borage of each and 

the data fOe is transferred to another system or host processor In the compressed fornv the 

fie directory aooomfianies the compressed groups. Retrieving com p ressed data firom a data storage devtoe 

is by r^rleving the group of data btocfcs having the data block(s) desired to be re^ 

of data blocks is transferrable between host proces s ors and data storage units without decompression. The 

DUI or grouixeceiving data storage medium may be formatted in the well known fixed-bloGk architBcture 

(FBA) formal* the well known count-key-data (CKD) format, the weH known extended oount4cey-data (ECKD) 

format or any other format. 

Embedments of the present InventkmwiU now be descrftied In more detal, with refarenoe to the accom- 
panying drawings in wtnch: 

Fq. 1 is a nowr chart Sustrating dala storing operatkms according to an embod^^ 
tkm; 

F^. 2 is a sinnpimedbkxicifiagiam of a data processing system In whteh the data storing operattonsao> 

confing to Fig. 1 may be advantageously emptoyed; 

Fq. 3 is a diagrammatk: raprasentatxm of a Logical Block Adcfress (LBA^ 

compressed groups of data bk)cks of a data fSe; 

Fq. 4 is a btocfc dtagiam showing details of an optkai data storage system at^ 
such as Is shoMffi lit Fig. 2: 

Rg. 5 is a btocfc (fiagram of a peripheral contniller usable in data processing systen^ 
in Fig's 2 and 4; 

Fq. 6 diagrarnrnalical V ilustrates storing a cornpressed group of data bk^ 
1; 

Rg. 7 < eagr am ma lkally ekistrates host processor commands using a SCSI connectfon to a data storage 
sy^em such as is shown in F^ 2 or Fig. 4; 

Fig. aA diagraivnatkaUy ahistrates a fBe directory of a plurality of compressed groups of data blocks of a 
fie according to an embodiment of the present Invention; 

Fig. 8B d ia gra mmatk aPy ihfitrates the format of a disk sector according to an embodiment of the present 
Invention; 

Fig's g-13 are fk>w charts showing detais of the operatk)n shown in F^ 1; 

Fq. 14 is a togk: diagram ihjstrating an application of the present invention to a multi-unit data processing 
system thsft has a pluralfty of data storage devk»s and host pR)oessors Interconnected by a d^ 
tocal area network; and 

Fig. 15 is a flow chart showmg machine operations that update a compressed data file according to an 
emtxxllment of the present invention. 

DETAILED DESCRIFT10N 

Referring now mora particiriarly to the appended drawings, lice numerals indkate Ifke parts and structured 
features In the varkMis figures. A data file having a plurality of data bk)cks is divkled Into one or more transfer 
units of data bkxAa. Before data storage, each transfer unit of data bk>cks is subjected to its own data com- 
presskmcycte to create a group of compressed data blocks. The size of the data transfer unit, in bytes. Is se- 
lected to be facie for addressing and retrieving individual recorded groups of compressed cteta btocks while 
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provkSng good channel itfiization and oom^^ 

part based upon data stiyaga efficiency* La 

tocated addressable dala storage areas. Each of the ^k)cated sec^ 

the last sector of a gm^ that may be partiaflyfaied tt rs desired to reduce the number of partiaBy fled data 
5 storage sectors for more efficientSy filing the FBA data storage disk with data. This desire is balanoed wfth 
enabBng efficient random access to the co m pressed data btocfcs^ored on the FBA data storage disk. 

Each stored or recorted group of compressed data blocks is accessed from disk 30 as a sir^ 
irrespective of the nurrter of disk 30 sectors in whch the group is recorded. Since each group <rfoonr9)ra$sed 
data btocks is compressed in aseparatodataoompres^operatkm. all of the data in each such group nust 
10 bedecompressedstarting with the beginning. Le. rvst compressed bytes, in each group. Theretora. in randomly 
accessing a corn p ra s sed desired data btock in a given group, aDofthe compressed date Mocks of each stored 
gn)up are read from disk 30 as a stngSe disk record. The single d^ record is decompressed up to the desired 
or addressed compressed date btock. The desired compressed date block is then decompressed tor p 
ing. iJrniting the aze of the groups of cornpressed date bkxto provkles for 
15 pressed date btocfc. This desire is balanced wth a desira to maximtze utOizatton of the disk 30 date storage 
speca An eoiampie of managing these two param^ers for creating a fade size group of co m pressed date 
btocks (that varies with each applkatxm) is descnbed later. 

In an aiteniate arrangernent* each date btock is separately compressed. Aptorality of such separately 0^ 
pressed date btodcs are oornbined bito a single cfisk leoord. The byte posmon wi^ 
20 each of the separateiy compresse d date blocks is recorded in the single disk record. Such byte posMon or offeet 
enables addressing each of the compressed date btodcs within a group. 

To fac iitete access to the groups of compressed date blocks, the host processor program mai nt ai ns a di- 
rectory thai Mentifies the addressable date storage areas containing the group as weO as the date btocks in 
the respective groiqis. This directory identifk»tton preftadily takes the 
25 tained in host processor H. Such directory is also stored on the volume or date ^or^e disk oontaintng the 
group(s) of cornpressed date btocks. Pr^ef^d)ly, the (firectory is transmtted to the 

transfer of a co m pressed fOe having piurai groups of compressed date btocks. This arrangement establishes 
on the FBA disk a directory that ^fects addressabSity of the compressed date blocks within the r^pective 
groups. 

30 Fig. 1 Bustrates recording a date file by grouping a plurality of date btocks of the file into a smaller number 
of groups of compressed date btocks. Step 10 is executed in a host processor 11 (Fig. 2). Adatefie,. or part 
<^ a date fie, is ktentTied for compressed date storage. The date file consiste Gf a plurei^ 
tenn date block includes date reoonto (coded date). sut>-fito stnjctores^ indivkhial 1^^ 
drawings ando the rfbrmsofgraphks> combined g^aphtos (non-ooded date) and text(coded date), and the lica 

35 As later dialed, the data fOe is divided into fade sized groups of data blocks for transfer as a d^ transfer 
unit DTU to a storage unit or over a corranun toatton link and for maintaining a random access capabiiy to the 
recorded groups of compressed date blocks. The size of each DTU and resultant recorded group is dependent 
on diverse variables^ asMD become apparent Completkm of one executton of ^p 10 resutts in one such group 
of date btocks l>elng selected for compression and storage. 

40 Step 13 is executed t^ host processor 11 (Fig. 2). The number of uncompressed date bytes to the DTU of 
date blocks (the pnxtoct of the number of date btocks times the number of bytes to each date btodQ s divtoed 
by the date storage capacity of one addressabto date storage area (sector of an FBAftarniatM 
ed to a next higher integer 7 the proctoct indudes a fractton. This number reprasento a maximum number 6f 
addressabto date storage areas required to store the data; either uncornprassed or if a compr^ston does not 

45 compress the date into fiewer bytes for storage. At this juncture, it is not known how many »klres8^e date 
storage areas are required to store the group of date blocks after compression. To ensure that the group of 
date bkMdis is storabte on the date storage rnedium ((H>tk»d disk 30 is used 1^ 

numberof the addressabto date storage areas sufftoient to store the entirs group of compressed date btocks 
is initially determined fbr storing the group of date btocks in an uncompressed form. 

50 Step 15 is «cecuted by biAhtte host processor 11 anddatestoragesystemlZTheselectedOTUofdate 
blocks is transintttad by the host processor to the date storage systeia The date ooniprasskm 
DTU of date btodcs is com pr ess e d before storage on the date storage rnedium 30 (Rg. 4^ 
methodotogies that may be emptoyed herein. The Fig. 1 1ndicated methodotogy requires the date store^e sys- 
tem to altocate the maxDmum mjmber of addressable date storage areas. Then the data transfier occurs requir- 

55 ing the date storage system to compress the selected DTU of date btocks just before the date are recorded 
on the date storage mecfitmi 30 (Fig. 4). Upon completion of the comprasston and date storage or recording 
as one continuum of data, date storage system 12 determines the number of addressable date storage areas 
actually used tostore the compressed group of date blocks. The unused but allocated addressable date stor 
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areas mtlien deallocated, rn the event that oe^^ 
the origretor u nco m presseddaiatheiv as wil become apf)^^ 
troi data are reconled on the FBA disk that indicates which date 
pressedL Such contnsi data are used HT) retrieving data 

rent As later ddaied m this spedTication, at step 16 data storage sy^em 12 serais the storage locatkMis of 
the >i^mxirded group of oornpressed data biodG to the host processor 11 fw 
data fBe to wtiich tlie recorcted group of data btodcs ^ a nrieniber. 

A second methodology has the data compres s ion-decompression performed in host f)rocessor 11. As 
such, host pTDcessor 11 indudes the data compress i on i nechanisrmett^ 

the compressed selected group of data lilocte to date storage ^stem 12 for storage^ this instance, if batch 
compression is used, tiost processor determines the numt)er of addressable date borage areas required for 
storingthecompressedgioupcfdatebtocksw Host processor 11 then sends the required numberof address- 
able date stoiage areas to date storage system 12 for allocation just before the cornpressed da^ 
mftted to the date storage ^fstam. 

In a thWrnethodoiogy, the uncompressed group of date Modes are transmitted twice tyh^ processor 
11 to date storage system 1Z Afvst trensmisskm enat)les (tete storage system 12 to accurately nwasure 
mimber of ad dr ess ab te date storage areas that wfl be required to^ore the coiiiprBssed data, to 
mission the date are cornpressed but not recorded. The nurnber of cornpressed date bytes are counted to d^ 
termine the date storage extent (number of sectors or addressable areas) for t he oomprassed date. The date 
storage system 12 then allocates the indicated nuniber of oont^uous sectors for recei^^ 
pressed data. Asecond transrnis»on of tfiesarne date to the date storage system 12 results In the cornpressk^ 
and storage of the com p re sse d date in a date storage medium. 

In each of the above descra)ed methodologies, if the number of lyytes in the compressed fDe is greater 
than the nurnber of uncoinpressed date bytes, then the date are recorded to the uncompressed fbrnt 
when updatir^ a group of compressed date btocks, the number of compressed date tiytes may exceed the 
capacity oftheavrendy^tocatedsectDrSw As described later wfth respecttoFig. 15, a change in altocatton 
of sectors fior storing the updating DTU may be required. 

Also^ to each of the above <tescrtoedmrthodotogles, the date blocks to be compressed and stored from 
each DTU are preferably com p ressed and stored as one group. That is, aJI date blocks to each DTU are com- 
pressed during one date compresston cyde to produce one group of compressed date blocks. An dtemate 
date cornpresskm ^proach is to imfivktoaOy conriprBss each of the date blocks 
of cornpressed date t)tocks connate of a plurality of indivktoaily conipres 
compresskm, a header to each gn)up can ktei^ the byte oftoet wfthto each gro^ 
pressed date btocks. Such indivkhiaHy compressed date btocks may also be ktentTied on the date recording 
disk l3y ilegai recording code characters, such characters are weO kmnvn for diverse date recording codes. 

Host processor 11 m step 19 togkarily assodates aU recorded groups of oornpressed date blodcsva 
descrtoedfiedkBdnry.VWienernploytogtheabovedescribedfirrt 

data, date staiagesystem 12 reportetohosl processor 11 theactualntantierofsectors used to store ttieoonv* 
pressed date and further address and Ntentifying date therefore, as win be described. 

At step 2f^ host processor 11 d^ermines whether all of the date to be compressed and recorded have 
been recorded. The (^ate regarding the recorded group of compressed date Mocks (see step 19) have been 
entered into the taterdescrtoedfaeiftectory (Fig. BA). If all of the above descnlied machine operattons have 
been compietBd, then the operatton is "done*, enabling exib'ng to other machine operattons beyond the present 
descriptkia Otherwise, steps 1(V19 are repeated as above described unti all of the date have been com- 
pressed and recorded. It is to be noted that other machine operattons may be performed by host processor 
11 in a mutti-taskmg or interrupt driven date processing environment whie steps 10-19 are to the process of 
executton as is known to the date processing art 

Fq. 2 shows a date processing ^tem in simplified forra Hostprocessor 11 attaches a date borage sys- 
tem 1Z Date storage system 12 induies a peripheral control 20 that connecte host processor 11 to date stor^ 
devtee 21. Devne21, to one embodiment of this inventton, is a magneto-optk^l date storage device ttiat op- 
erates with removable magneto-optkal date storage media era single medium (disk). As later used in thisspeo- 
ifkariton, the term programmed machtoe indudes host processor 11 , peripheral controller 20 and programmed 
portkms of date storage device 21 . The compresston-decompresston mechanisms are preferably in the pro- 
grammed machine. For in-line compresston-decompresston, ft is preferred that the oompresston-decompres- 
ston occurs to the peripheral controller 20. As toter described with respect to Rg. 14, the tocatton of the conv 
presskHMteoompresston mechanism can be anywhere in the pro gr am m ed machine. For batch compresston- 
decompresston it is preferred to plaoe the compression-decompression in host processor 11 . 

Fig. 3 IhistiatBs a togkarf btock address (1^) ^ucture 23 used to nragn 
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temsforacklressingseclCTSofanopt^ 

enables fiM ad y aitogB of p ractic in g the present mvertion^ Ttts sector acfalresstng b based upon the togical 
addressing fioitfid in many present day optkal (fisk da^ 
dresses data on dfek 30 (F^ 4) using a logical blOGk addr^ 
5 of the addressabtephysxald^ storage addressable areas, such as sectors, are acft^ 

LBA addiesSb bi an alternate addressmg ai mngei neiit host processor 11 requests access to a named fie. This 
alternate addressing arrangernent includes host processor 11 identifying byte location wfthin thefie to begin 
a data operation and a number of bytes (byte length) to be subjected to the data operation, L& read from the 
disk, for example. 

10 LBA 23 is managed by either one of two aigomhms. A first one has been used 

algorfthnx the number of entries in iBA 23 is constant for each disk and is based upon the number of address- 
able entities in the <fisk designated for storing data Spare addressable data borage areas or sectors are not 
included in the 1^23 to^cai adcfress sequence, as Is known. Known secondary p« 
spare sadors via LBA 23l 

15 A second algortlan for addressing using LBA23 is used In miotic flexible diskettes. In this second al- 
gorithrn, the adifeess range of IBA 23 varies with the roirnber of demarked or umisaM 
tries for adckessing only the tracks and sectors that are designated fw 

sectors identifiable by the ihistrated address translation becomes unusable, then the unusable or defective 

sector is skipped and replaced tyy another sector. Such substSution is weB known. 
20 AO of the addressable tracks and sectors on disk 30 m addressed via LBA23. Such addressing i^ 

look up matching the host processor 11 supplied logical address toa physical disk track and sector storiigthe 

data kJentified by the supplied logk^ai address. Each LBA logical «Mress has one entry 14 in LBA 23. 

Numerals 17 and 18 indicate groups of compressed data blocks recorded on disk 30 using the present 

inventioa Nurnerai 17 indicates the fret group of compressed ctobtocks of one fie. bidicates 
25 subsequently recorded groins of compressed data bkxdcs from the same fBe. The enumeration of the data 

btocks in the recor d ed groups 17-18 is maintained in Its original sequence as generated by host processor 11. 

As win becorne apparent the coinpressed data blodcs In the respective groups are hJentifi^ 

shown in Fig. 8A. 

Amagneto^)plk:data8tDra9edriveord0vk»21 isQIustratedIn Fig.4asitisco^ 

30 11 via peripheral oontro8er20. As usuaL peripheral controfler 20 is p£Hd(aged^^ 

n^o-optic record (fisk 3D is rernoveablyrnounted for rotation on spindle 31 by motor 32. A usud disk cartridge 
receiver (not shown) is in operative relation to spindle 31 for onserting and ejecting magneto optical or other 
optkaldisks30mtoandfinDmdrive21. Optical portion 33 of driv^ ismountedonframe35. A headarm car- 
riage 34 rnoves radialy of disk 30 for carrymg an objective lens 45 from 

35 suitably mounts carriage 34 for redprocating radial motions. The r»lial motions of carriage 34 enable access 
to any one of a pluralfty of concenbic tracks or circumventions of a spiral track tb^ 
data on and from the (fisk. Linear actuator 36 suitably mounted on frame 35, radially moves cariage 34 for 
enablbig track accessing. The recorder is suaably attached to one or more host processm 
essors may be coiitrulunds, personal computers, large system computers, oomnnunicatfon systems, biiagestg- 

40 nal processors, and the Bca Attaching drcuSs 38 provkte the logkad and elec^ 
optical recorder and peripheral controller 20. 

Devk» miaoprocessor 40 controls devk»21 including t he attachnientcinsuits connected to peripheral con- 
troOer 20. Control data, status data, oornrnands and the like are exchanged bet^ 
devfce mkaoprocessor40via bkfirectionalbus43. Inchided in micro-processor 40 is a program or microcode- 

45 storing, read-only rnernory(R(M) 41 and a data and contrd signal storing randorn-aa 

The optics of the reoorder(drive or devkse) 21 include an objective or fbcusong tens 45 mounted for fbcusing 
and radial tracking motions on headarm 33 by fmeachjatDr48. This actoator includes mechanisms fry moving 
lens 45 toward and away from disk 30 for focu^ng and for radial movements parallel to carriage 34 motions; 
for example, for changing bracks within a range of 1 00 tracks so that carriage 34 need not be actuated each 

so tinfie a track adjacent to a frack currently being accessed Is to be accessed. Nurner^ 
light path between lens 45 and disk 30. 

In magnelD^»ptic recording, magnetic bias field generating coil 48. In a constructed embodiment elecfro- 
magnet provkies a weak magnetic steering or bias field for directing the renviant magnetization dffectfon of a 
smal spot on disk 30 ihanmated by laser light from lens 45. The laser light spot heats the Qlummated spot on 

55 the record disk toa temperatore above the Curie point of the magneto-optic layer (not shown, but can be an 
altoy of rare earth and transitional metals as tajght by Chaudhari et al., USP 3,949,387). This heating enables 
riiagnetcoi 48 generated bias field to dnrect the rerrmamrriagnetization to a desired direction of magnetization 
as the spot cools bekiw the Curie point temperature. Magnet col 48 Is shown as sup^^ 
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in the >ri^cfirection.Le>, binary ones 

Toefas8<fisk30»ma9netcoi4dsuppriesafiekisothe south pde is »Qacent(fefc3a Mattel ooi 48 control 
49 is electricaly coupled to magnet ooi 48 Ofver Ira 
^nefated magnetk: r»fcl Mimprooess^ 
leversal of the bias field ma^ietic polardy . 

It is neoessaiy to control the racfialposflion of the beam folk^ path47sudithatatrackordreumv«>> 
hjtkm is fiaihftjy fdlowed and that a desired trade or 

end, focus and tracking drcufls 54 control both the coarse actuator 38 and Hne actuator 46. The positioning 

of carriage 34 by actuator 36 is precisely controBed by control signals su pplied by drcuits 54 over line 55 to 

actuator3&Addmonally,thef!neaGtualor46 control by circuits 5^ 

tofine actualDr46omrines 57 and 58w respectively for effecd^ 

ing actions Sensor 56 senses the r^ative position of fine actimtor ^ 

ative posftion error (RPE) signal line 57 consists of two signal a)ndu^ 

error signal to drcuds 54 and a second ooncbidor fbr canying a fo^ 

focus mechanisms In fine actuator 46l 

The focus and traclOng posdion sensirig is achieved by analyzing 
path 47» thence through leiG 45^ through one^ialf mirror 60 and to be reflected t^ half^^^ 
"qi^d^Bctor* 62. Quad detector 62 has four photoeiements which respectively supply stgrals on four lines 
a)llectively denom i n a ted ly numeral 63 to fooB and tiacldngcinaite 
wit h a track oeriter I ine^ track foOoMng operations are e naU 

the light IhtensOie s detected by the four photoetements in the quad detector 6Z Focus and tracking circuits 
54 analyze the signals on lines 63 to control both focus and tracking. 

Recording or vwfting data onto disk 30 is next described. It is assumed t hat magnet 48 is rotated to t he 
desired posikm for recording data> M i croprocessor 40 supplies a control s^ 
for indkatnig that a reoonling operatfon is to ensue. This rneans that laser 67 is energy 
a hlgh-intensfty laser light beam for recording: In contr^ for reading* the laser 67 emitted laser light beam is 
a reduced intensty for not heating the laser iluminated spot on disk 30 above the Ciro 
plies as cOTtrolsigmd over line 68 to laser 67 and receives a feedback s^naio the laser 

67 emitted I jg h t in tens i ty. Control 68 adjusts the light intensity to the des&ed valua Laser 67, a semkXMiductDr 
laser, such as a gallium-arsenkte (fiode laser, can be modulated by data signals so the emitted l^ht beam rep- 
resents the data to be recorded by intensdy modulatk>n. In t his regard, data circuits 75 0ater descrft>ed) supply 
data indk:atlng signals over line 78 to laser 67 for effecting such rnodul^^ 

through polarizer 70 Cinearly polarizngthe beamX thence through oollimating lens 71 toward half mvror 60 
for being refiectBd toward (fisk 30 through lens 45. Data ctrcuHs 75 are prepmd for recording by the nttcro- 
processor 40 supplying suiabfo control signals over line 76. Mk:roprocessor 40 in prep^g drcuits 75 is re- 
sponcfing to commands for recording received from a host processor 11 via attaching circuits 38. Once data 
circuits 75 are prepared, data is transferred directly between peripheral controller 20 and data drcuits 75 
through attachnig drcuils 38. Data circutts 76, also andBary drc^ 
rials, error detectfon arid correcttori arid the Gke. CirojilB TC, duriiig a r8«l or re 
signal from the re^lbacksi^ials before supply corrected data signals overbuy 
via attaching drcufts 38. 

Reading or recovering data from (fisk 30 for tiansmisskm to host processor 11 requires optk^ 
processing of the laser light beam from the disk 30. That portton of the reflected 
larlzatfon from polarizer 70 rotated by disk 30 recording using t he Kerr e 
path 47, throi^ lens 45 and half-rntrrors 60 and 61 to the data detectkm portkm 79 of the he^ 
Haif-rnirnyorbeamsplftter 80 dlvkles the renected beam into two equal intensft^ 
renected nMed linear polarizatkm. The halF^itirror M 

issettopassonly that refleclBdiigMwhch was rotated when the remnant nragn^izat^ 

accessed has a 'north" or bmary one indicatfon. This passed light impinges on photocell 82 for supplying a 

suHaMe incficating s^nal to differential amprrier 85. When 

pdedirectkmremnantrnagnetizatfon, then polarizer 81 passes iK> or very Ift^ 

being suppfied by photocell 8Z The oppositooperatfon occurs by polarizer 83 whkii passes onl^ 

laser light beam to photocell 84. Ph<^ocell 84 supplies Us signal indicating its received teser light to the second 

input of (fifferential amplifier 85. The ampirier 85 supplies the resulting deference signal (data representing) 

to data drcuits 75 for d^ectfon. This detectnn, in the Qlustrated embodiment, does not indude digital demod- 

ulatkm (deo)diiig the read back signals from a 1-7 d-k code to data in a host processor forrn^ 

signals incfcide not only data that is recorded but also all of the so-called ancfllary s^nals as well. The term 

"dataT as used herein is intended to indude any and all Informatbn-bearing signals, pr^jerably of the d^ital 
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or disGrela value type. 

The rotaUuifci potion and rotatioiiai speed cfspmdle 31 is sensed by a suitable tachometer or emitter 
sensor 90. Sensor 90, pr^^erably of the optical^»aism9 type tha^ 

wheel (not shown) of ^'ndte 31, supplies the tach* signal (digaal signals) to RPS clrcuft91 which d^eds 

therotationatposaionorspfndeai and supplies rotatfonal uift i i ui ali on-t^eafmg signets to microptoce ss or 40. 

Microprocessor 40 empl«^ such rotational signals for oonM 

as is widely practiced in the magn^ data storing disks. Addition 

speed osntrd drouds 93 fDr asntrofling nK>tor 32 to 

may include a crystal-contolted oscfllator for oonteOtng 

suppGes control signals over line 94 to control 93 in the usual manner. 

Peripheral controller 20 is shown in Fig. 5 This oontroier Inchides the compression-deco m p r essfon mech- 
anism for in-Gne or realty data cori^ression-deoompressicm. A connect araJ 
peripteral controller 20 is effected by a SCSI module 100 that implements the known small computer system 
interfiaca An lO data buffer 103(dynamx:aBy aOocatad hto input data buffim and output data buffers using 
known tedmk|ues) teriv)or^ stores data leoeived from or to be trs^^ 

ical DiskCbnliDler (ODC) 104 manages the reading and writing of the data to the disk 30 (Fig.4). Error Cor- 
rednn Control (ECC) module 106 detects and corrects errors in data being read and generates ECC error 
d^ectkm and oorrectfon rec^ndanqr characters to be wrftten to the medium with the data. ^ 
(RLg (nK)d-dernod) encoding and dea)ding is perforrned In data ci^^ 

and decodes reco rde d data patterns, such as used in the Icnown 1-7 decode. Microprocessor 107 (plus ccmtrol 
store 108 and dynamk: store 109) controls the vartous elements of the controller 20. A Compresston/Deconv 
presskm (CD) modufe 101, such as an integrated circuft referred to by Shah etal. supra, implerr^nts thecom- 
pressnn algorfthmsw CD module 101 inchjdesautomatk: cffcuit timing and control, as is known* to control data 
ftow through per ip heral controller 20 imdersupervfefon of mteroprocessor 107. This compresston^ecompre fr - 
snnisihrBaltinrieCin-line)withthedatatransfer. Busses 102, 11^ 111 interconnect the mocMes, as shown. 
ControRer 20 is preferably packaged wfth a device 21 on a common frame. 

Rg. 6 Qhistrates compresskm of several data t^>cks into one group of compressed data btocks recorded 
in a numberofdatastoring sectors 118 <rf track 117 of disk 30. Agroup IISofapturalityofdatabtocksllBis 
selectedllorieoonlihgasdescrtedwtthrespecttDF^. 1. Group 115of compressed data bkxtois transmitted 
to oontroier 20 by host processor 11. CD 101 tncontroller20 compresses group 115suffk:iently to be recorded 
as a group of compressed data bfocks in sectors 118 plus about one-half of sector 119. The remaining half of 
last sector 119 is faied with padding tiytes, as is known. Numeral 122 indicates a sector that was altocated 
prevkwsly. Numeral 123 Micatesa neKtsector(s) that were Initially allocated according to the abov»^escra)ed 
firs t me th odology. Tt» linked response of co n trolter 20 to the wrae-cornprBssoon^ 
essor 11 that sector(s) 123 are to be dealtocated as such sectors dkt not receive any of the data ftom 90up 
115. Host processor 11 responds to oontroOer 20 to deallocate sectors 123. 

The above descriptnn assumes that host processor 11 is perfbrming data space mare^ement This ar- 
rangernent is usual. It is to be pointed out that 11 a multi-host arrangement of shar^ 
the hosts may be designated to perform space management Also, in some systems the periphery controller 
per fo rm s data storage space management 

Fig. 7 ilustrates in abbreviated form three ooinmancte for use in a known SCSI i 
130 inchides the operatkm code field 131 that iraficates the command is a WRITE command. LBA address 
fiefcl 132 indcates the first LBA address that data being transmitted in accordance with the instant WRITE 
comrnand is to begin (the towest IBAaddress off possibly several LBA addresses req^ 
data intoa pkff^tty of ifisk 30 sectors). Fiekl 133 DKficates the nurnber of unl^ 

from host processor 11 to devk» 21 for storage on disk 30. One unit is that data storaUe in one sector of the 
disk 30. FBAdisks may have different data storing capacity sectors, suc^ kb). 2048, or 4096 

bytes of data. FieM 134 imficatee whether or not the data to be transmitted is to be compressed. Reld 135 
indkates that this WRITE command is linked to read buffer command 140. This corrvnand linkage requires 
peripheral controller 20 to report to host processor 11 the detaOs of the data storage, Le. number of sectors 
actually used, the data that enables host processor 11 to build an entry for the later described Fig. 8A eiustratad 
fie (firedory* arid klentifies the sectors to be deaOocated. It is noted that LBA 23 b updated in host processor 
11 with a copy thereof recorded in a sector of disk 30. Also, a copy of the Rg. BA fliustrated file directory is 
recorded on disk 30, preferably in a uncompressed form at a Vast LBA 23 logical address that invnediately pre- 
cedes the first LBA address for storing compressed data. 

Read buffiBr SCSI command 140 inductes operatmn code field 141 that indicates the command Is a READ 
BUFFER command- Controller 20 responds to receipt of a READ BLiFFER conrvnand to transfer data from an 
outputregistBr(8) of IObuffer103.Contn)Oer20 stores the Mb^ 
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date blocks in 9udio^^ 

linked to the WRTTEGonvnand 130. Feid 142 indkates to controller 20 the nivnber of sectors used to stm 
the compressed datobtockSw That is, ho^ processor 11 knovvs the nwnber of disk sectors requked tor storfng 
tte compressed data btocks, hence the new entry fty the OA austratgd fie dgectory, 

READ DATA command 145 has operatkm code ftekl 146 having an ndkstnn that the oorrvnand is a READ 
DATA oomrnand. The rorstlBA address to l>eised for transfe^^ is 
tndk»tedtnrieM147.Rekf 148tndkatesthe number (n) of data t)k>cksfBque^ or convnanded to be trans- 
ferred from the FBA cfisk to the host processor 11 . Reld 1 49 indicates to controller 20 the monber (N) of disk 
sectors that are to be read. Rekt 150 indcates that decompress is ertheron oroff. Lkikon bft 151 is usually 
resettobeinactiva For reac&ig one group (rfoompressed data Nocks, contra 
(hO of sectors, decompresses the d^btocks, then transfOT the decompressed data bk)ck^ 
11. Controller 20 counts the nunter of data blocks transferred such t^ 
148 is reached, the data transfer » terniinated. The data block counti^ 

The Fig. 8A iBustrated fie (firectory can bidicato dffferem le^ 
dependent Every fife that has data btocks recorded In groups of compre s sed data Mocks has a separ^ 
tton of the diectory respectively todbatad by numerals 161 , 1 ^ and 103 for three (Afferent data files. Each 
row 160of each <&Bctory represents one entry. Afrst entry in each directory include incotomn 164 the fie- 
name of the fie and the LBAaddress at whkii the directory is recorded on disk 30. 
top most entry iwficatBs the nurnber of da te b to ckski each data transfer un^ 

indkstes thata^ven numberof date btocksare to be transferred between d^ 30 and host processor 11 during 
each date transfer. The rernairiihg entries 160 are respective 

pressed date btocksw Again, column 164 in the respective entries indicates the flr^LBA address used to store 
the group. Cdumn 165 indcates the number of date blocks recorded and the number of sectors used to store 
the respedivB groups of coinpressed date btocks on disk 30. Once al of the date t)tocks are 
single date ooinpress operatkm. the group of cornpressed date blocks areacontinuiHn of date with no e^ 
indicatfon of the date btock boundaries. The decompresston mechAnism and nosnrifltftd ppntrolg Mentify the 
date block boimdartes after deoompressk>n, as is known. 

In adcmkm to the irtfdrrnatxm contained in the Fig. BASIustratBd file dir d^aOsof each 

group may be provkled In such an alternate irnplernentatton of the fie directory^ 

dHkm, for each group cf compressed date btocks (i.e. for each respective entry of the Fig. 8A illustrated file 
cfirdctory) a nrap of the relatnn of date btocks and date storing sectors (uses the 1^ 
actual physfeal tocatton on disk 30) for each of the groups. This addittond informatton is used by the host to 
manage the recorded date and unused disk 30 sectors IndnatBd in LBA23u 

AU entries oontein the abO¥eindk»tadnkapping of date bkxte 
(Gp.) of con>pressed date btocks in the current fiaTtet Is, each date Mock Is indi^ recorded in 

<m8 or more sectors, <tependk)g on the con^^resston and size of the date btocks. Severn compressed date 
Mocks ntay be recorded in one sector. Inthis instance, the LBA addresses are the sarnefo^ 
Le. LBAto to ftM^examptocouU occur for several date btocks. 

A format (tf the Rg. BA lustrated directory using the additkmal addtassing Mbrmatton is set fort h below. 



First entry 


Flename 


Number of date btocks in a date tran^ unit 


Second entry 


6p.1LfiA 


Number of date btocks and sectors in this group 




date block n 


LBANatbyteB 




datebtockrH^I 


LBANatbyteB^ 




datebk>ckn^2 


LBAN2atbyteB3 



50 (Map of all date btocks to group (Gp.) 1 oontbiues, term nyyte" indkates byte displacement of the respecth^ 
com p ressed date btock as recorded in a sector.) 



Third entry 



6p.2LBA 



Number of date btocks and sectors 



(Map of date btocks to LBA addresses is set forth above) 

The superscripts merely indicate 1st (no super script), second, ete byte posittons of the respective blocks 
n, n^-1, rH'2etCL 

The above described directory structures enable the date contente of a single group of compressed date 
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blod8 to be ig>dated wfthnit the necessdy of re^^ 
of compressed data block only requires the reacfingcrf 
of compressed data btocfcs may require mom sectors for storage than that ti^ 
group otf cornpressed data bfocks. That is adcSionai sectors 
5 cgoupofoornpresseddatabtoiAsarerffittirriiwtincontigu^^ 
fBctm sectors), a new aOocation may be required 
Host processor 11 uses this nrifbrmation to determine the ne^ 

have sufficient mmiber of addresses (sectors) for storing the updated group of compressed data blocks. 
For WORM (write once, read many) optk:al disks, the host processor may ssue a MEDIUM SCAN com- 
10 mand to tocate the next available LfiA addressed sector for storing the updated group of compressed data 
bk)cks. Host processor 11 saves this inforrnalion in an expanded directory entry for use v^rhen the data are to 
be retrieved or read. 

As later described wfth respect to Rg. 10, another control paran)^ is a miniinum or maximum numb^ 
cf sectors to be used in the CKD and ECKD examples for practictrig the present invention. The number N of 

f5 sectors required to store the unocrn p ressed data is amipared with a MIN(nt!^^ 

imum vahie). irthe nurnberof requked sectore is b^ween the MIN and MAX vahjes, the^ 

the nuntber hi MIN ensures a reasonable usage of disk storage space whie MAX ensures a reasonaU 

to compressed data bkM^SL If N is greater than MAX. then N is made equal to MAX. If N is less than M 

N is made eqasA to M) N. The number of data bytes in a DTU is N^B (SB is number of bytes storable n one 

20 sector) for FBAdevwes and rM>B(DB is manber of data bytes desired for storing one <teto block) for CKD 
and ECKD devk»& The mmiber of bytes in a DTU is stored in the fvst or top entry 160 (Fig. 8/^ of each fQe 
directory. As one variatkm. field 166 in each of the entries 160 contains a compress DTU indicating bit C. If C 
is unfty, then the data represented by the respective entry 160 are recorded in a compressed form. If bft C is 
zero or nfl. then the data are recorded on (fisk 30 without date coinpresskMi, The compressed bit C may also 

25 be recorded in each and every sector storing date in accordance with the present tnventfoa 

Rg. 8B diagrammaticaUy ihistrates format of a d^ sector of an FBAdisk. Sector 170 b in track 169 of 
disk 30. Intersector gap 171 separates sector 170 from an immediately preceding sector (not shown). Sector 
ID 172 is an embossed area that contains the track and sector address of sector 170. Intrasector gap m 
arates the hanl sectored or einbossed rnark 172 from the magneto-optkally recorded portton that oon^^ 

30 the remainder of sector 170. Date synchronizatton signals DATA SYNC 174 are magnetooptKally recorded 
with the date stored in portkm 175 of sector 170. Contn)l area 176 stores nragn^o-optkalJy record 
signate. as nrtay be desired A coriipress bit C 177 (considered a part of the control s«^^ 
to unity indicates that the date in portion 175 are compress. If C 177 Is settozero or na. then the date stored 
in portion 175 are not corn p rBssed.SectDr170 ends with the error de t ectkm and conectbn re 

35 178 portioaECC 178 Stored Signal are generated and stored in a known manner that is not pertin^ 

understanding of the present inventnn. Intersector gap 179 separates sector 170 from a next succeeding sector 
180. It is preferred thatoon^ress bit 177 be used whOe practicing the present tnventton. 

Fig. 9 b a fkjw chart showing a sequence of machine operatkms for storing a fie in a pluid 
of corm^ressed date bkxte wherein each group is separately transmmadfromahn^ 

40 system as a DIIJ having a nuniber of uncompressed bytes as set forth above. At step 185 the date to be r^ 
corded is analyzed for deterniining the niHnber of DTlTs to be generated. The actud size in 
of a DTU may be d i fferent from fie to file. In step 186, the DTU size is modified to accomnodate the number 
of date btodcs to be mitlally recorded for equalizing the sizes of a plurality 
if the number of date bkMte to be compressed and recorded is less than two desired DTU's an^ 

45 the numberof date btocks results in a nun^of date bytes greater tf»n MIN» then two DTlfs each having 
one-half of the date btocks are created. This same principle is applied to t ra n s fe rr in g date blocks having any 
number of DTl/s except for updating a recorded group of compressed date btocks, as wffl become apparent 
If the DTU sizBS cannot be equalized, then a last DTU may have a number of bytes less than the MIN (minimum) 
number of bytes. Upon updating the recorded group of compressed date btocks resulting from a smaO last DTU, 

90 aDTUis^^neretedthataddsanuniberofctetebtockstomakethesizeoftheDT^^ 

datebtocks^largertomeettheDTUsizerequirementesetforth withrespecttoFtf89and 11. 

to updatf ng a recorded group of com p ressed date btocks iDustrates machine steps for storing an updated DTU 

that is too large for the current allocated date storage space for a recorded group of co m pres s ed date blocks 
residting from com p ressing and storing the updated DTU. 

55 At "GET DTU" step 188(F^ 9X a DTU of date blocks is buOt for date transfer. Step 189 transfers the DTU 
to date storage system 12. Date storage system 12 compresses and stores the transferred DTU as described 
eariier. At step 190, host processor 11 ascertains wh^her another DTU is to be transferred. If not (DONE = 
1 ), then host processor 11 exOs for performing other vifork not rdated to practi^ 
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wfee; steps 188 and 189 are repealed wtfi ai anfs have bem 
Rg. 10 is a flow chart shovMTig selecting a MINan^ 

grapNcs) d^ and text (coded) data The conipressa)idy of data is a 

tfBs regard, each fie of image or tead data may corripresssubs^^ 
5 wefi 83 changing frorn data t)lock to data block tn either type of da^ 

blocte haw t)een com p re sse d and recorded as a gwmp of compressed data blocka^tte 

be recorded in the Fig. SAilustratedfle c&ectory as a reference for subsequent compression and storage of 

data blocKsw The 10 fflustialnn assiiines that the image data to 

age data blodcs are 25% of original size) and text data Mocks have been com pres^ 
10 iffed values may be chan^ for cateutation purposes for ^ding a margin of error accommodalion into the 

cscuanons* 

Step 195 d^ermines wh^her the data in the file is text or Image, if image, step 196 cdculates the MIN 
value as 4*SB (bytes in a sectoiX leL at least fbur sectors are to be used fiDT stor^ 
data bk)dcs. The nurnberfoiF is satected in an artMlrary manner. Sector size affsds the minimum number of 

f5 sectors to be used Step 197 calculates MAX as being 64*SB. In a FBAdisk having 1024 byte sectors, then 
the maximum DTU size is 64 KB (Kiobytes). Agaki, sy^em coriskleratk)ns may change these vahies. Such 
oonslderErtions are beyond the present descr^ptkm. From step 195, tbr text data (IMAGE DATA= NO), step 200 
calculates MIN as 2^ whie step 201 cak:iiates MAX as 32*SB. The number of uncontpress^ 
age data n MIN and MAX is equal to the nunber of uncompressed bytes for text data. T^ 

20 sionratns change MIN and MAX values inversely to the expected compression ratkx Upon oompleting either 
calculatnn, host processor 11 stores the M!N and MAX values in thefnst entry 160 
fie (firectory and then exits the calculatk)n. 

The MIN and MAX values inay also be predeterriuned and inchided as pararneter data den 
data as set forth in Gelb et al US patent number 5,018,060 tilled 'ALLCX^ATING DATASTORAGE SPACE OF 

25 PERIPHERAL DATA STORA^ DEVICES USING IMPUED ALLOCATION BASED ON USER PARAME- 
TERS*. Gelb ai teach that data set parameters implicitly control peripheral data storage operations. Such 
Implkit control based on data base or fSe paramo data may be applied to practidng t he present inventk>n. 

Fq. 11 showeexecutkmof aWRITEoornmand by datastoragesystem 12vvherM 
in on DTU are a)rnpressed then recorded as a group of compressed data btocfcs. Step 21^ 

90 command 130. Step 211 s^ the link commanded in field 135 for reporting the actual number of sectors used 
to store the resultant group of cor np ressed data blocks and a compression rattoCR achieved. St^ 
acornpress nnode En data storage system 12for activating CD 101 to compress the data blocks bei^ 
Dito one continuum of compressed data. Step 213 receives, oornpresses and stores the D 
216oomparBS the number of sectors actually used to store the compressed data with the nun^ 

35 in&iaOyalkxated. Step 217 cornpares the byte count of the or^nal<fedabl^^ 

byte countof the compressed data bk>cksw In most instances, the byte count of the compressed data blocks 

wai be less than the byte count of the original DTU data btocks. In this instance, at step 21 8, date 

tern 12 Micates to host processor 11 that the data storage operatbn has been complex 

of any imused sectors pks other Information describing the just-completed data recording operatkm is to be 

40 transferred from data storage system 12 to ho^ processor 11. This transfer is ^ect^ 

respOTKfing to the Miction of a completed recording operatton by issuntg a READ BUFFER command 140 
to data storage system 12 to send the number of unused alk>catBd sectors and all other oon^Mession infor- 
matkm to host processor 11. Host processor 12 in step 219 responds to the imfKatkm of unu^ 
tors to dealtocate such sectors for use bi storing other data Note that if the compress bit 134 off, then no 

45 compression occursL 

If at step 217, it is deterrnined that the data cornpresston resulted rnore data bytes in the oonnpres^ 
bkKks than were in the original data bkx:ks, then the data bk)dcs wil be reconM 

This growth in size of the co mp ressed data bUxks may occur when the original data blocks have certain data 
patterns In any event at step 22(^ data storage system 12 sends a channel convnand retry (C^ 

50 alem to host processor 11. OCR nwficates that the DTU has to be retransmftted by 
storage system 12. That ls» the increased in size of the DTU after oornpression is oonsM 
The OCR indfcates that a record in g error has occurred. Host processor 11 responds to the CCR at step 221 
by resending the DTU to data storage system 11. At step 222, data storage system 12 stores the Dl^ 
data compressbn. The above-itescn'bed operatkms are exited from either step 219 or 222. 

S5 Fig.12baflowchartshowingsystemoperat»nsf6rreadingdataHostprocessor11ln8tep225prepam 
to read data, L,e:identiries the data bkxAs to be read. Host processor 11 then in step 226 secffohes for a f ile 
directory (Fig. 8A)l Such file directory rnay be read from dis^ If there is no file directory relating to com- 
presskm, then the date are not cornpres se d Also, if the r»ld 166 of the Fig. 8 illustrate 
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tinedgniiipis2era^thentt)atgm4>isnoto^ Further, f data to be read are cornpressedaid rtb 

desked to decompress in a ui^ olhef the stormg data storage system 12, step 226 (firects host processcy op» 
eratbns to read aB ideftfied d^ wfthoitf decompiession via path 2^ 

operation not imlo^^in9 date oompresstobpert^^ buidstssuesoner^AD 
5 oorranand145f(Dr each ofthereoorvted groups of compressed data bloctetobe 
read operation, field 150 or READ command wll be set to mdicate efther de^^ 

Ho^ processor 11 before sending the READ command 145 to data borage system 12 exanunes field 150 at 
^ep 226. If host processor 11 at step 226 firafe that the data to be read are com p ressed and decompression 
is de^red, then step 230 s^ fieM 150 to compress ON. All of the groups of compressed date 

10 dateblodcstobereadareidentriednstep231 viaexaminatkmoftheapprv^^ 

processor 11 in step 232 then buids one or more READ cornrna nds 145 for reading the step 231 identified 
groups <a compressed date bkxAs wt h deoompressaoa The term bufld used above indicates that the appro- 
priate control date are teerted into a READ oornrnand for corrvnandtng date storage sy^^ 
desired re»L Such comrnand includes the nurnber of LfiA addressed sectors to be read as well ^ 

15 oldressmLBAofafvstoneofthe sectors^ One READ oorranand is sent by host pr 

system 12 bi step 232. there can be a number of READ commands sent for fetching a phJFErirfy of groups of 
record blodcs. Date storage system 12 receives the READ corranand. At step 233, date borage systo 
the sector c ompress bftofthe first sector storing the requested group to be read. If bl 0 177 (Fig. 8B) is unity, 
then the date are compressed. Date storage system 12 then to step 234 reads the requested group including 

20 decompressing the data. It is to be noted, that if the READ command f ield 150 indkates decompression is 
OFF, then no deco mp ression occurs even gbac 177 is set to unity. On the other hand, if bit C177 equals 
zero (date in the sector are not ccmipressed), the at step 235 date storage system 12 reads and sends the 
read date wihout deoornpression to host processor 1 1 . The Fig. 2 ehjstrated system 6X&S the rea^ 
for one group from efttier step 234 or 235. 

25 Fig. 13 ilustrates operation ofdate storage system responding to a READ oorrmiand 145. Step 23^ 
t he READ cornrnand. Step 237 ctecks t he compress f idd 1 50. If t he am press field indica^ 
is ON, then C bft 177 of the sector being accessed s checked to ensure that the date to be read is in tect 
recorded and stored in a compressed form. Step 238 executes the READ command by decompressing the 
date being read fffiekt 150 indk»tesoompres8k>n and C bit 177 is ON. If themd 150 ^ 

so OFF, the date stored to the addressed sectore are transferred without decompresston whether cornpres^ 
or not Th£tt is, to afl cases, date storage system 12 transfers the date without decornpresskm 
cates compress is OFF. This control enables transferring date in etthercompressed or d e com p res s ed farm 

Rg. 14 itostrales one applkatkm of the inventton m a system having linked ho^ 
and in line date co mp r e s sfc OTftteco mp ressfon are employed. Oompresston^leoompresston softwae modules 

35 251 and 273 prDvkle batch date compression ami decompression whOe integrated ctrou^ 

press decompress) 253 and 272 provkle in One (real time) date oompresskMMieGompresston Two date proc- 
essing systerns 240 and 241 are Biriced by date link 263. Link 263 rn^ be a local area network (L^ 
oornrnunicatkm circuft or transfer of a rennvable date cartrklge 

twodate processing systems Host processor 250 to system 240 has a software co m p r ess-decompress fadity 
40 251, a txmsfer fink fodity 252 that involves no compresston or decompressbn and an in-firm hardware conv 
press-decorn p res s facitty 253. Facflitfes 251-253 rnay be physkadlytocated to date 
host processor 250 or as a part of a channel connectfon that indudestogfcswiteh 254 (progr^^ 
ware) connecting host processor 250 to fiecflities 251-253. Dashed line 255 lndk»tes that switch 254 is pro- 
grammlnglycontroaed by host processor250.Agfven date processing system may have only 1) batch compress 
45 tecOity ^1 and lird( ted% 2) MTme teca^ 253 and link tecBity 252, 3) ail facOities 251-253 or 4) either 
tecaity251 or 253 may be located either to date storage system 2K or date Imk 263. 

The topuNMtput (lO) connecltons linom facitties 251-253 are effe^ 
mingly controlled by host processor 250 as indksted by dashed line 261. Switch 260 directe 10 date ftow be- 
tween facaities 251-253 and a date storage system 262 or date line 263. 
50 Date processing s^^tem 241 is shown as being identical to date processing system 240. Date processing 
system 241 indudes host processor 270 that may have a different oomputattonal arrangement and capabiity 
from host processor ^SfK logk: swteh 271 , tecaities 272-274, date storage system 275 and switch 277 that se- 
lectively omnecte date processing system 241 to date link 263 to other systems and date processing syst^ 
240. 

S5 Fig. 15 austrates updating a recorded group of compressed date btocfca Host processor 11 in step 280 
has updated date btocksanddesirestoupdateafSe recorded in date storage system 12 as a plurality of groups 
of compressed date btocksw Step 281 compares the date length (number of uncompressed date bytes) of the 
updating DTU wfth the number of bytes in sectors currently recorded as one group to be updated. Host proo- 
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eswltateoeacaninesthemwterofpaddi^ 
whether or not the updated data blodcs are stonM 
iipctetPdL 

At step S2 host processor t1 determines wt^her or net the upctating DTU can be stored In currently ^ 
located sectors or more or ififBient sectors should be aflocat^ 

bytes than the currently recorded group, then adddional sectors are allocated at ^ep 288 (tost processor 11 
(toes tte allocation). Such new sectors are pr^erably contiguous sectm 

taHimg the recorded group of data Nodes to be updated. FoQowing allocation step 288. the updating DTU is 
recorded at step Tton» host processor 11 at step 290 deallocates the sectors oontaintn^ 
blodcs to be updated. The Rg. 2 ilustratedsystern then exits the updating operatbn from step 290. 

If, at step 28^ the number of data bytes in the updating DTU is substantially equal to the number of bytes 
(uncornpressed) of the recorded DTU, then the updating occurs at step 283 using the sectors Gunent^ 
the group to be updated. The Fig. 2 BIustratBd system then perfbnns ste^ 

eralion. If the updatmg DTU has fiawer bytes than the recorded group, then the updating DTU is recorded in 
sectors selected llom the sectors oontainirig the gnwp to be updated. TTm sectors not used to r 
dating DTU are deatocated at step 290. 

It rnay be decided that independently of any data growth patterns, to always store the updated date 
in a newly aOocated set of sectors and to deallocate or free the sectois storing the current group(s) of com- 
pressed date Mods to be updated te this smiation. steps 288-290 are perfonned Fb^ 
desire to save the original group(s) of compre ss ed date Mocks, such original recording may be reteoned. Host 
pn)cessor11 then updates the appropriate fge directory 160-162 arwiexite the borage oper^^ 

In the updating operation shown mPig. 15, whenever the compressed date hce more bytes than the orig- 
inal uncompressed data, the date are recorded in an uncompressed form. The steps shown in Fig. 11 area 
to the F^ 15 Vuslrated seqyenca 



Claims 

1. Apparatus fbr storing date in co m pressed ftorm in a date storage device having a plurality of addressable 
like-sized date storage areas, each tor recording a predetermbted number of date bytes, the date storage 
devk» besig coraiected to rneans fbr receiving date to be recorded, sakl received date being ar^^ 

a pkiialily of addlressabte date blocks, characterised In that the apparatus oornprises^ in 00^ 

selectwn means in the means for receiving date fbr selecting one or more date transfer unite of 

date btodis to be recontod, each said transit unit of date btocfcs having a given number of date bytes 

and induding one or nwre of sakJ addressable date blocks; 

compression means cormected to the selectton means fbr compressing sakttransfiBr unit of date 

btocfcs to be recorded as a group of compressed date btocks; 

date access ineans h the devkse connected to said cornpresskm means fbr recording ^ 

ofcoriiprBssed date btodts in saw addrBssat)le date storage areas as or» continuum of compressed datt^ 
and 

directory ineans indk»ting vrhk^ ones of sakf addressabte date storage areas saki 00^ 
date is recorded to, and mdicatihg that said continuum of date contains saki selected transfer untt of date 
trfocks in a compressed form 

2. Apparatus aooordvYg to daim 1 ndudtng: 

alocatnn means connected to the selectton means for responding to the number of date bytes in 
each saki tran^ unit of date btocks to indicate that sakl transfer unit requires a first number of saki ad- 
dressable d|ate storage areas to record saki transfer unit of date bk>cks; and 

recording means fbr recording said transfer unit as a group of compressed date blocks in a second 
number of sakl addressabte date storage areas, said second nunber being equal to or less than sakl first 
numt)er. 

a. Apparatus according to daim 2 induding update means connected to sakt setednn means and to said 
altocation rneans fbr updating a recorded group of compressed date btocks with update 
cfciding receiving updated ones of sakl date blocks and selecting a date transfer unit of date blocks to in- 
ckidesaki updated date btocks; said update means being connected to sakl altocatton means for allocating 
a nunter of sakl addressable date storage areas for receiving and recording sakl updated compressed 
date btocks and for dedtocating ones of sakl allocated addressabte date storage areas in whk:h are stored 
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the original gR»g> or compressed data faiod^ 

Apparatus acoonirig to any one of dams 1 to 3 
storage devte for se»ec:t!ng said gnfen 

mnnber of (kbytes which are recofxta^ in each of said data storage areas. 

Apparatus according to any one of dawns 1 to 4, inctoding range nieans indicating a range of number of 
bytes to be used far transfearring data biodcs between said means far receiv^ 
device, wherein said setedion means is connected to said range me^ 

and responding to the received range indication for selecting a predetermined number of said data btodcs 
to be a data fer»isfer unit arid to be ffi ofie of said grcxips of data Modes such that each sak^ 
bfc>dGS has a nurnber of data bytes equivalent to a plurality of uncompressed data biocte 

Appaiatusaooonfingtoanyorieofdaimsl to5 wherein the apparatus inchides: 
CKD means far supplying a phirafity of CKD data blocks; 

a CKD formatted disk within the data storage device for receiving and recording CKD data; 

said selection means being connected to said CKDrneans far receiving and sd^^ 
mined nurnber of saki CKD date btods as a data transfiBr uftit of said CKD data bk)dc8; 

said data access means having CKD recording means for recording said transfer unit (tf CKD data 
as compressed by said cornpre ssi on means as a single record on sakJ CKD formatted disk; and 

repeat rneans oormected to said sdectfon means and to saki CKD rneans for repeatedly actuating 
the CKD means to supply a transfer unit of CKD data bkKte for corn pr esskffl and recording 
single CKD records. 

Apparatus a ccord i ng to any one of dakns 1 to 5, induding: 

a host processor connected to a peripheral contrdler, said data storage device bet^ 
said peripheral controller^ 

an FBAsedoredcfisk in sakt data storage devtee having a pforality of adctnessaUe sectors for re- 
ceivir^ and recordii^ data blocks; 

saklseledfon means having means for selecting sakJ data blocks for said data transfer unit to be 
recorded in a predeterrnmed nun^ of sectors on saki FBA sectored disk; and 

repeat rneans connected to saM seiedkm means for repeatedly actuating the sdedfon 
selecting a pkiiaGty of saM transfer units of data blods from one fOe ^ 

and recordmg of snd transfer unite of data blocks such that sakt fBe of data btocks is recorded in com- 
pressed form on sakt FBAsedored disk in a plurality of saki contirajtBn of data where^ 
consists of one sakt group of compressed data Mocks. 

Apparatus according to any one of the preceding dakns. inchiding dato reconfing management means 
connected to sakt directory means and tosaM data access means for actuating the directory means to 
estaMish a phjrdity of sakl fie directories, one file directory for eadi f Be of data recorded in con^^^ 
form; sakt recording management means actuating sakj directory means to record in each of saki fie di- 
rectories a number of saU dala btocks to be induded in each of sakt data transfer units of dat^ 
chiding reconftig a ma}dmum mirnber of bytes to be Induded In any one of saM 

A rn^hod of oornpresskig and recording onto a data storage rnedium data of a fBe whfah is arranged in 
a phiiality of addres sable data Mocks» the method comprising the steps of. 

sdeding a plurdity of sakt date btodcs of sakl fito to be compressed and record 

segmenting the selected ptorality of addressaMe date Mocks into one or more date transfer units; 

compressing each of saki one or more date transfer units and recording them as respective sep- 
arate groups of compressed date Hocks; and 

creating and maintaining a fto directory indicating the address and size of each of saki recorded 
groups for enabrmg rmidom access to recorded date within sakl fOeof date Mocks. 

A method according to daim 9 induding the steps ot 

before reconfing one of sakt groups of compressed date Mod(8, altocatlig a first nurnber 
dressat>le date storage areas of the storage medium for recording saki one group of compressed date 
Mocks; and 

after recording sakl one ^p <rf compressed date Hocks, deallocating aOocated addressaMe date 
storage areas, any. kito whkii sakl one group of compressed date btocks was not recorded 
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tl. AfnethodaooonfingtDiiaim9ordaim10.inch^ 

supplying CKD formatted data bkxi^ 
to b& oompfessed and leoofded; 

oompressmg one or morB data transfer unitsof sakJCKD data blocks mto one or more gfoups* re- 
^KGtMy, of oorrqvessed CKD data bkscfcs; and 

reoonfing the one or more groups of compressed CKD data blocks as one record on a CKD for- 
matted record memlier. 

1Z AmethodaocordfngtDdaimdordaffnIOJnduding: 

selecling an FBA formatted record medhjm to be sakJ record medkim, saM 
medkm having a phiralfty of addressaUe data-storing sectors, each data-st^^ 
recori fe ig a given number of data bytes; and 

selecting said data transfer unft to have a first predetermined number of said data blocks having 
a number of uncompressed data bytes equal to a data storage capacity, in data bytes, of a second 
d^ermmd rajmber of sakl data-storing sectors. 

13w A method according to ariy one of daims 9 to 12, nriducfing: 

setting a range of nurnber of bytes to be included on each of saki data transfer uni^ 
selecting a number of saki data bkicks such that a number of data tyytes in the setocted number 
of data bkKks Is wfthin the set range. 
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